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Abstract 

We derive the zero-temperature phase diagram of spin glass models with a generic fraction 
of ferromagnetic interactions on the Bethe lattice. We use the cavity method at the level of 
one-step replica symmetry breaking (IRSB) and we find three phases: A replica-symmetric (RS) 
ferromagnetic one, a magnetized spin glass one (the so-called mixed phase), and an unmagnetized 
spin glass one. We are able to give analytic expressions for the critical point where the RS phase 
becomes unstable with respect to IRSB solutions: we also clarify the mechanism inducing such 
a phase transition. Finally we compare our analytical results with the outcomes of a numerical 
algorithm especially designed for finding ground states in an efficient way, stressing weak points 
in the use of such numerical tools for discovering RSB effects. Some of the analytical results are 
given for generic connectivity. 

PACS numbers: 75.50.Lk,75.40.Cx,64.60.Fr 
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I. INTRODUCTION 



Spin glasses are among the most complex models in statistical mechanics that can be 
treated analytically. Even at the mean field level their solution is highly non-trivial Q|. 
Moreover when the distribution of the disorder (the distribution of the couplings Jij in 
the present case) is not symmetric enough, e.g. it has a large positive mean Ej[Jij] > 0, 
the model solution becomes still more complex: Ferromagnetism and spin glass order may 
coexist in the so-called mixed phase. 

The presence of a mixed phase witnesses a very complex energy landscape, with non- 
trivial thermodynamical properties. Indeed mean-field spin glasses are expected to have a 
mixed phase, while scaling theories, like the droplet model 2|; do not seem to leave any 
space for such a phase. 

Recently the authors of Ref. studied numerically ground states of the Edwards- 
Anderson model with an excess of ferromagnetic couplings in 3d and they found no clear 
evidence for the existence of a mixed phase. Alternative explanations of their results, com- 
patible with the existence of a mixed phase, are the following: (i) the size of the mixed 
phase in the 3d EA model may be very tiny; (ii) finite size corrections may be huge and the 
thermodynamical limit approached very slowly; (iii) consequences of the replica symmetry 
breaking may be hard to detect in the presence of a strong bias (the global magnetization); 
(iv) given a large number of quasi-ground-states (with similar energies, but different mag- 
netizations) the numerical algorithm used in Ref. j^l may have some small bias to find more 
easily ground states with small magnetization. 

In order to shed some more light on the above possible sources of error we believe it is 
very useful to perform a detailed study of the mixed phase in models where such a study can 
be done at an analytical level, i.e. models with long-range interactions. From the analytical 
solution one can extract information on e.g. the size of the mixed phase and the presence of 
low-energy states with different magnetizations. Moreover, finding ground states with the 
same algorithm of Ref. ^ and comparing numerical outcomes with the analytical solution, 
one can study finite size effects and possible sources of bias in the algorithm. 

The complexity of the analytical solution to spin glass models with long-range interactions 
depends on the interaction topology. Those models where each spin interacts with all the 
rest of the system (fully-connected topology) can be solved in a compact way thanks to 
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the Parisi ansatz (see e.g. the recent work by Crisanti and Rizzo i^"]). On the contrary, 
the complete solution to those models where each spin interacts only with a finite number 
of neighbours (Bethe lattice topology) is much more complicated Even the simplest 
solution with only one step of replica symmetry breaking (IRSB) involves a functional 
distribution of distributions as the order parameter. Luckily enough such a complex solution 
can be simplified in some cases: e.g. at zero temperature ||6|, and when sites are equivalent 

Q ^ nn 

(factorized solution) [7| or when only zero-energy configurations are taken into account j8|, |9| . 

Spin glasses on the Bethe lattice has been extensively studied in the second half of the 
eighties [ID , U , 3, 1^ • Unfortunately at that times it was not completely clear how to 
break the replica symmetry in a way which allow for an analytical treatment: A standard 
replica calculation for spin glass models on the Bethe lattice would involve an infinite number 
of overlaps! Until few years ago only replica symmetric (RS) and variational solutions were 
known for spin glasses on Bethe lattices. 

The same definition of "mixed phase" is not clear at the RS level, since it can not 
be distinguished from a non- homogeneous ferromagnet. Indeed at the RS level only two 
macroscopic parameters give the full description of the system: the magnetization m = 
'^i'lTLi/N and the overlap q = 'Ylii^f/^i where m-j is the local magnetization on site i. 
Given that q > m?, the only possible RS phases are the following: 

• g = m = 0: paramagnetic phase; 

• g > 0, m = 0: unmagnetized spin glass phase; 

• q = m? > ^ rrii = m \fr. homogeneous ferromagnetic phase; 

• q > > ^ rrii depends on the site: Both the non-homogeneous ferromagnetic 
phase and the mixed phase belong to this class and are thus indistinguishable. 

So at the RS level the presence of a mixed phase can only be deduced from the fact that 
on the RS-to-RSB instability line the magnetization is non-zero, assuming that it does not 
drop to zero in the RSB phase. The only direct way of observing a mixed phase is to look 
for RSB solutions with q > m? > 0: in this case a non-homogeneous ferromagnetic phase 
corresponds to RS solutions, while a mixed phase to RSB solutions. 

In this work we will concentrate on spin glass models with a generic fraction of ferro- 
magnetic interactions defined on Bethe lattices with fixed connectivity. In order to simplify 



the calculations we will perform a zero-temperature analysis of the ferromagnetic /spin-glass 
transition at the level of replica symmetric (RS) and one-step replica symmetry breaking 
(IRSB) solutions. 

To our knowledge, the best description of the zero-temperature phase diagram of this 
model is the one given by Kwon and Thouless They used a variational RS approach 
where the local fields may take any real value. However, in a model having discrete energy 
levels a real- valued local field is unphysical. Moreover, given that our main aim is the study 
of the mixed phase in spin glasses, the use of a RSB ansatz is strictly required. 

Thanks to the reformulation by Mezard and Parisi of the cavity method for finite 
connectivity models, we are able to derive the correct phase diagram of spin glasses with 
ferromagnetically biased coupling on the Bethe lattice and to investigate the mixed phase 
directly with a IRSB ansatz. 

The main questions we would like to answer are the following. Can we locate exactly the 
boundaries of the mixed phase? How does the size of mixed phase change with the model 
connectivity? How wide or tiny do we expect to be the mixed phase in the 3d EA model (if 
any)? What is the physical mechanism inducing the RS to RSB transition? How "strong" 
are the measurable effects of RBS in the mixed phase? From the numerical point of view, 
how large are the finite size effects in locating the phase transitions? Is there any bias in 
the ground states found by the numerical optimization procedure? 

The work is organized as follows. In Sec. |H]we recall model definition and we write cavity 
self-consistency equations to be solved in Sec. IIIII for Bethe lattices with fixed connectivity 
3. There we also compare numerical data to the analytic solution. In Sec. IIVI we present 
some result valid for generic connectivity. Finally in Sec. |3 the answers to questions in the 
previous paragraph are discussed. 

II. THE MODEL AND ITS SOLUTION WITH THE CAVITY METHOD AT ZERO 
TEMPERATURE 

We consider a 2-spin interacting spin glass model on a Bethe lattice with fixed connectivity 
c = k + 1. The Hamiltonian of the problem is 




(1) 



<tj> 
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where cxj = ±1 are Ising variables. The couphngs Jij are quenched random variables ex- 
tracted from the following probability distribution: 

P( J) = <5( J - 1) + ^ S{J + 1) . (2) 

The parameter p G [0, 1] is thus 1 for the ferromagnet and for the unbiased spin glass. 



We analyze the problem with the cavity method at zero temperature |2| . The cavity 
method is based on the analysis of the messages u passed between sites and cavity fields 
h acting on each site. Following the standard procedure one can write self-consistency 
equations for the distributions of ms and /is, that give (if the process converges in the 
thermodynamic limit) the solution of the model. The basic hypothesis of the above method 
is the absence of strong correlations between two randomly chosen spins: This is true for 
Bethe lattice topologies where the typical loop size is of order log(A^), which diverges in the 
thermodynamic limit N ^ oo. 

In this work we use the cavity method at two levels of approximation. The first level 
corresponds to considering the system with a single thermodynamic pure state, and it is 
formally equivalent to the Replica Symmetric (RS) approach of the replica method. The 
second level corresponds to assuming the existence of many equivalent states, which is 
equivalent to apply the replica method with a one step Replica Symmetry Breaking (IRSB) 
approximation. 

A. Self-consistency equations 

For models having discrete energy levels, cavity fields at zero temperature only take 
integer values, since they are related to the difference among energy levels 0]. Moreover for 
the present Hamiltonian, given the cavity field h on a, site, the corresponding message sent 
along the link leaving that site and having coupling J is m = sign(J/i), with the prescription 
that sign(O) = 0. So for any message we have that u G { — 1, 0, 1}. 

In the RS case the self-consistency equations are 

V{h) = l\{dQ{ui)5{h-Y, , (3) 

i=l i=l 

Q{u) = J dV{h) 5(M-sign(J/i)) , (4) 
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where Ej represent the average over the disorder distribution in Eq.(j2I), and V{h) [resp. 
Q(u)] is the probabihty distribution function (pdf ) - over the system - of cavity fields (resp. 
cavity messages). 

The sohition to RS equations can be written in terms of the probabihties po, p+ and p_, 
defined by 

Q{u) = po 6{u) + p+ 6{u -l)+p- 6{u + 1) , (5) 

with the constraint + P+ + = 1- 

Going from the RS to the IRSB solution each field hi (resp. message Uj) is replaced by a 
pdf Pi{h) [resp. Qi{uy\ and the order parameters become probability distribution functionals 
of pdf, V[P] and Q[Q]. 

The IRSB self-consistency equations are thus 

V\P] = I \{DQ[Q,]5'^^^[P-P,[Q^,...,Qk]\ , (6) 

Q[Q] =EjJ DV[P] [q - go[P, J]] , (7) 
where b^^^ is a functional delta and the functions Pq and Qq are defined by 

Po[gi,...,gfc](/^) = ^ / nrfQ.(n,)e-KE.KHE,«.l)5(^/,_^^,^) , (8) 

^ i=l i=l 

Qo[P,J]{u) = J dP{h)6(u-sign{Jh)^ , (9) 



where the normalization in Eq.(jH)) is given by 

k 



i=i 



(10) 



The IRSB self-consistency equations depend on the "reweighting" parameter /z, which 
corresponds to the zero temperature limit of the Parisi breaking parameter, m ~ /iT. The 
solution to such equations, as well as the corresponding zero-temperature free-energy will 
depend on yU. 

In full generality one can write the pdf of the message Ui as 

Q^{ui) = r,f 5{ui) + 4^ 5{u, - 1) + r^i') 5{u, + 1) (11) 

and describe the pdf Qi by the variables ?7q*^ and Ar^*^*) = 77^^ — r]'^^ . So the order parameter 
Q[Q] becomes the joint pdf Q(?7o, Ary). Examples of this distribution can be seen in Fig. |21 



B. Free-energy, energy and complexity 



Since the RS solution can be formally obtained from the IRSB one in the /x — limit, 
we will write only IRSB expressions. 

The free-energy is composed by two terms 0. The first term, $site, is computed 
merging c messages Ui, each of them having a pdf Qi randomly extracted from Q[Q] 

= -- I \{DQm log / ndQ,(n,)e-^(^-l"'l-'S«"'0 = 
^ i=i i=i 

= -- [ flDQ[Q,] logA,[Q,,...,Q,] . (12) 

^ i=i 

The second term, $nodc; is computed in the following way (let us write the expression for a 
generic p-spin interaction, being p = 2 in our case) 

$node(/i) = / flDV[P^] log / fldm,) e-^^'^(-^n.^.) = 

^ i=l J i=l 

= ~j DV[P]DQ[Q] log j dP{h)dQ{u) e-2/^^(-''") , (13) 

with the prescription ^^(0) = for the step function 9{x). 

The zero-temperature free-energy is given by a proper combination of the two terms (let 
us write as before the expression for generic p-spin interactions, being p = 2 in our case) 

$(/!) = -- + $sitc(/i) - -(P - l)$node(/i) • (14) 

p p 

Please note that Eq. lfT^ gives the right free-energy expression only when it is calculated 
with Q[Q] and V[P] solving the self-consistency equations. 

As shown in Ref. [6|, the cavity free-energy $(yu) is the Legendre transform of the com- 
plexity or configurational entropy S(£'). Then, in full analogy with replica calculations jisl ]. 
one can write 

E{fi) = 9^[/i$(/i)] , (15) 
S(/i) = /i[E(/i)-<|.(/x)] . (16) 

The complexity curve S(£') can be obtained as a parametric plot in the fi parameter. The 
ground state energy of IRSB solution is given by the maximum of $(/u), while threshold 
state energy is given by the maximum of E{fi). The solution of the present model in the 
spin glass phase is expected to have an infinite number of replica symmetry breaking. In 
such a situation the true threshold energy is certainly lower than its IRSB approximation. 



III. CONNECTIVITY 3 CASE (k = 2) 

For the ease of simplicity we will present all the details only in the k = 2 case, i.e. fixed 
connectivity 3, where many calculations can be done analytically. We leave for the next 
Section the results in the generic connectivity case. 



A. RS solutions 



The RS equations ()3I4|) can be written very easily in the two variables po and m^s = 
— p_ (that is the magnetization of the RS solution) 

Po=pl + [{l-Pof~mls]/2 ^^^^ 

m-KS = P(l +Po)"^RS 

These equations admit a paramagnetic solution with po = 1 and p+ = p_ = 0, a spin glass 
solution with po = P+ = P- = 1/3, and two ferromagnetic solutions with 



1 / 10 3 
po = --l mRs = ±W8 + 18 

that exist only for p > 3/4. The magnetization and the energy of the RS solution are plotted 

in Fig. ^ From the RS analysis one would predict solely a spin-glass/ferro transition at 
p^s = 3/4. 

It was already suggested in Ref. [13[ that the RS phase could be unstable for p smaller 
than some Prsb- Actually the instability seen in Ref. is from integer to real- valued 
fields, which is unphysical. Nevertheless this unphysical instability may suggests that a true 
instability of the RS solution towards RSB solutions could be present. 



B. IRSB solutions 



In order to study the mixed phase, that is the coexistence of spin glass order and ferro- 
magnetic order, the replica symmetry needs to be broken. The mixed phase corresponds to 
a RSB solution, i.e. < p < oo, with non-zero magnetization, i.e. Q[Q(u)] not symmetric 
under the transformation u ^ —u. 

We solve the IRSB equations ()6I7|) using a population dynamics algorithm similar to 
the one used in Ref. We evolve a population of (r^o. A?]) pairs, representing the joint 
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pdf Q{rio,Ar]), until the population becomes stationary. A single evolution step consists 
in randomly choosing k = 2 pairs (i^q^'*, Ar/^^^) and (t^q^'*, Ar/^^^) from the population, and a 
coupling J randomly with distribution P(J). Then a new pair {'r]ll^\ Arj^^^) is generated and 
introduced in the population, replacing a randomly selected pair. The expressions for rj^^ 
and A?7*^'') are the following 

(( 

^0 



,(0) _ 1 



A 



2 
J 



(19) 



1 - 



Ar7(°) = ^ (l + r]r)Ar;^^^ + Ar^W(i + ^i^i) , (20) 



with A2 = I ^ ((1 - r^'i^l - r^f ) - Ar7(i)A77(2) j ^ (31) 

The stationary joint pdf Q(?7o, A?]) depends on both p and /i, giving the following scenario: 

• for p > Prsb — 0.833 the system is in a RS ferromagnetic phase; 

• for p < Prsb the RS solution becomes unstable towards RSB solutions; 

• the IRSB solution has a non-zero magnetization as long as p > pp^^^ ^ 0.715 (mixed 
phase) and becomes unmagnetized below pp^^^. In general pp^^^ < pp^ holds. 

In Fig. n we show the magnetization and the energy of IRSB ground states, i.e. those 
states maximizing $(p): the IRSB full curve leaves the RS dashed curve below prsb and 
becomes p-independent below pp^^^. We have checked that our unmagnetized spin glass 



16| 



solution coincides with the one found in previous works 

Considering p values different from the one maximizing $(p) we can get information also 
on metastable states. We find that (i) at the same energy level states with different magne- 
tization do exist and (ii) states with higher energy typically have a smaller magnetization. 

In Fig. 121 we show the order parameter Q(?7o, Arf) for two values of p, with p chosen such 
as to maximize $(p). For p = 0.7 < pp^^^ (unmagnetized spin glass phase) the joint pdf 
Q(?7o, Arf) is symmetric in Ar], that is QijiQ, —Ai]) = Q(?7o, Arj). For p = 0.8 > pp^^^ (mixed 
phase) the symmetry in At] breaks down and the pdf becomes more dense around one of 
the bottom corners - the one on the right in this case. The presence of RSB is still clearly 
manifested by the spread of the points. 

For p > Prsb the system enters the RS ferromagnetic phase and the order parameter 
Q(?7o,Ar7) becomes trivial (for this reason we do not show it), either becoming a delta 
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FIG. 2: Probability distributions in the unmagnetized spin-glass (left) and the mixed phase (right). 

function on the point of coordinates (po^^^Rs)) either concentrating on the corners of the 
triangle, with weights p_ , po and p+ (from left to right) . 

Actually we observe that approaching Prsb from below the value of /j, maximizing the 
free energy diverges. As a consequence broad distributions are suppressed and only delta- 
shaped Q{u) survive. The correct RS limit is thus recovered with — > oo and Q{r}o, A77) 
concentrating on the corners. 
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FIG. 3: The complexity S as a function of e ^. For each curve, the part corresponding to physical 
states is the one on the left of the maximum. 

Finally we observe in Fig.Elthat, increasing p toward Prsb, the number of states decreases 
rapidly (please note the logarithmic scale): e.g. for p = 0.8 the maximum of the complexity 
E is an order of magnitude smaller than for p = 0.72, and this implies that much larger 
system sizes have to be used in order to detect numerically the RSB effects. 

C. Stability of the RS solution 



Among the transition points that we have found with the numerical solution of the IRSB 
equations, the one in Prsb signaling the instability of the RS solution with respect to RSB 
fluctuation can be calculated analytically. 

From the IRSB order parameter Q(?70) ^^7) one can get back the RS solution in 2 ways 



Q(?7o,A?7) ^ Q'^lirjo^Ari) =5{'r]o~Po)S{Ari-m^s 



(22) 



6{7]o)6{Ar]+l) + 



+ po Sivo - 1) S{Ar^) + ^ ^° + ^^^ 6{vo) 6{Ar^ - 1) , (23) 

where po and m^s satisfy the RS self-consistency equations (fTTj) . Our purpose is to analyze 
RSB fluctuations around the above 2 solutions in close analogy to what has been done 
recently in Ref. 
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FIG. 4: Pictorial view of the IRSB order parameter above (left) and below (right) the instability 
point. For p > prsb (left) the distribution is concentrated on the three vertices and it is stable 
under small fluctuations in any direction. For p < /Orsb (right) fluctuations along the upper sides 
get amplified under the population dynamics. 

Fluctuations around Q|^g(?7o, Ar;) are always irrelevant. Indeed if we replace the 2 delta 
function in Eq.((22I) with very narrow functions, the variances of these functions evolve 
through the matrix 



whose eigenvalues are always less than 1 (in absolute value) as long as p > 3/4. This would 
imply a RS ferromagnetic phase always stable. 

However what we observe numerically is that the RS ferromagnetic state becomes unstable 
around Prsb — 0.833, and for p slightly below Prsb the population is very dense on the top 
sides of the triangle (see right panel of Fig. |21). This last observation suggested us to study 
RSB fluctuations around Q^l{riQ, Arj) towards a distribution of the following kind 



which is concentrated on the corners and on the top sides of the triangle (see pictorial view 
in FigE}. 




(24) 



+ dxe_{x)6{r]o-l + x)6{Ar] + x) , (25) 
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In terms of pdf Qiiu), the Q[Q] in Eq.(j2SI) has the following composition 



5{u) with prob. 

5{u — 1) with prob. p+ 

Q{u) = I 5{u + 1) with prob. p- (26) 

(1 — x) 6{u) + X S{u — 1) with prob. e+(a;) 

(1 — x) 6{u) + + 1) with prob. e_(x) 

In the following perturbative calculation, the weights on the top sides e+(x) and e_(x) will 
be considered positive and very small: e+ = e+(x)(ix ^ 1, e_ = e^{x) dx ^1. In 
order to simplify notation let us use the following short names for the 5 distributions in 
Eq.dini): 5o, S+, Q+{x) and Q-{x). 

Our purpose is to calculate how the weights e+{x) and e^{x) are modified under one 
iteration of the population dynamics, given by the expressions in Eqs. (j6l7p . The only delicate 
point is the convolution of the k = 2 pdf Qi and Q2 in Eq.®, that we write in a shorthand 
notation as Qi * Q2- A non-trivial convolution appears only when the messages ui and U2 
are in contradiction, i.e. when they have different signs. An explicit calculation yields 



with 



1 — X 



(27) 
(28) 
(29) 



1 - (1 - e"2M)a; 

Please note that, for any finite value of /i, is a bijective map of the interval [0, 1] onto itself, 
and it has the nice property that f^{f^{x)) = x, implying that 5+ * Q-{,f^{,x)) = Q^{x). 

In a single step of the evolution dynamics, the combinations of parents that produce a 
distribution Q+{x) in the population of sons are the following: li J = 1, 60 * Q+{x) and 
5+ * Q^{ffi{x)), and, if J = —1, 60 * Q-{x) and (5_ * Q+(/^(a;)). Analogous expressions for 
Q- (x) can be obtained with a + ^ — substitution. Each one of these expressions must be 
multiplied by a combinatorial factor 2. In terms of probabilities we have then 



e+{x) = {1 + p)^poe+{x) +p+e-{ff,{x))\fl{x)\ 

+ il-p)[poe-ix)+P-e4Ux))\f^ix)\ 

e^x) = (l + p)[poe4a;)+p_e+(^(a;))|/;(a;)| 

+ (1-p) Poe+{x) +p+e^{f^{x))\f {x)\ 



+ 



+ 



(30) 



(31) 
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The above expressions hold for continuous functions e+(x) and e_(x). In the case these 
function were made of delta functions, the factors \f'^{x)\ would not appear. 

In order to calculate the instability point Prsb, that is when fluctuations along the top 
sides become relevant (see Fig. 0]), it is enough to consider the total weight on the top sides 
e+ and e_. Integrating Eqs. (j3(JI31|) over x G [0, 1], one can easily obtain an expression for 
the evolution of the vector (e+, e_), given by the matrix 

f (1 + P)Po + (1 - P)P^ (1 - p)po + (1 + p)p+ \ ^22) 
\^ (1 - p)po + (1 + p)p- (1 + p)po + (1 - p)p+ ) 

Plugging into Ai the values of po, p+ and p_ corresponding to the RS ferromagnetic solution 
(I18|l . one finds that the largest eigenvalue (in absolute value) of Ai becomes larger than 1 
at Prsb = 5/6 = 0.833333. We have thus found an analytic expression for the instability 
point seen in the numerical analysis, and the agreement is perfect. 

Let us notice en passant that prsb = 5/6 coincides with the instability point found in 
Ref. [ist j w here the instability of integer- valued distributions towards real- valued ones was 
studied UM- This inte gers-to-reals instability is quite formal and in principle should not 
correspond to the physical one. However some other cases have been found where such 
a coincidence can be shown to exist. 

Since for p = Prsb the vector (e+, e_) is an eigenvector of M. with eigenvalue 1, a possible 



set of solutions to Eqs. ()30l3H) is given by 

e+{x)/e+ = e^{x)/e^ = S{x) ='^an^6{x - Xn) + 6{x - f^{xn)) +C{x), (33) 

n 

where C{x) is a continuous function such that C{x) = C{f^{x)) |/^(a;)|, Va; G [0, 1]. 

It should be then evident that the subspace of functions S{x) which become unstable 
under the population dynamics for p < prsb contains also functions which are very different 
from those corresponding to the RS solution {6o, 5+ and (5_), e.g. the function 6{x — x*) 
with x* = 1/(1 + e^^) being the fixed point of the map 

Moreover we observe numerically that the distribution which is actually reached by the 
population dynamics is very broad, continuous and with no delta functions. 

So, in this model, the RSB instability produces an infinitesimal fraction of distributions 
very different from the RS ones. On this aspect the instability of the present model is differ- 
ent from the one studied in Ref. 17[ for the p-spin model. In that case the RS distributions 
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{So, (5+ and acquire a small width, remaining close to the unperturbed ones. We have 
also studied this last kind of instability, and it turns out that in the present model it becomes 
relevant only for p < 0.8265 < Prsb, when the RS solution is already destabilized towards 
the IRSB one. 



D. Comparison with numerical simulations 

In order to compare the analytical solution obtained under the IRSB approximation with 
numerically computed ground states, we have run an algorithm analogous to the one used 
to obtain data in Ref . jsf . More specifically we used the Genetic Renormalization Algorithm 
of it is a heuristic numerical method for computing spin glass ground states with a 
very high level of reliability. It uses a population based search (thus the name genetic) and 
applies optimization on multiple scales (thus the name renormalization). We have computed 
numerically the ground state for Bethe lattices with fixed connectivity 3: system sizes range 
from = 64 to = 512, and the number of different sample changes with A^ in order to 
keep the statistical error roughly constant. For the size studied here, errors on the ground 
states energy due to the heuristic are smaller than the statistical errors |l^. Note however 
that due to the discrete nature of the problem, there is a degeneracy of ground state, so even 
if we do find a ground state with probability almost 1, the algorithm may have a natural 
bias towards some of these ground states, as we shall discuss. 

In Fig. El we compare the analytically computed magnetization (the dotted line is the RS 
approximation and the full line is the IRSB approximation) with the magnetization of the 
ground states found by the numerical algorithm. Numerical data are far from the RS result 
and are mostly compatible with the IRSB curve. Nevertheless, deep in the mixed phase 
(0.73 ^ p ^ 0.76), we also find evidence that the extrapolation to the thermodynamical 
limit of the numerically measured magnetization is below the analytical one. This effect 
actually reduces the size of the mixed phase measured numerically. 

A possible explanation to this effect is the following: given a model, like the one we 
are studying here, which has many degenerate or quasi-degenerate states with different 
magnetizations, an algorithm looking for such states, starting from a trial configuration of 
zero magnetization, most probably will stop in a state of magnetization smaller than the 
typical one. Such an effect has been already observed in Ref. Q]: in that case a simple 
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FIG. 5: Comparison between the magnetization of ground states found numerically (data with 
errors) and the analytic prediction under IRSB (full line) and RS (dotted line) approximations. 
Statistical errors on numerical data is of the order of symbol size. 
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FIG. 6: Binder cumulant measured numerically for different system sizes do not cross at the same 
point, suggesting the presence of strong finite size effects. 

algorithm for the search of ground states always found states of zero magnetization in a 
situation where the thermodynamical magnetization was non-null. 

We also tried to deduce from the numerical data the critical point pp where the magne- 
tization disappears. In Fig. IHlwe show the Binder parameter for sizes = 64, 128, 256, 512 
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together with analytical predictions (RS dotted line and IRSB full line). Increasing N, the 
crossing point moves to left too much in order to be able to do any accurate prediction of 
pp. This is a clear evidence that, for this model, finite size effects are huge and make very 
hard to extract information from numerical data. 

Let us stress an important difference between the present model and a similar one with 
Gaussian coupling, which has been studied in Ref. 2l| numerically and analytically at 



the RS level. The authors of Ref. 



2l| found that all the numerical results were perfectly 



compatible, within the statistical error, with the analytic predictions obtained under the 
RS approximation: for this reason they concluded that RSB effect were tiny in that model. 
On the contrary here we can clearly see that numerical data are incompatible with the RS 
results: e.g. the crossing points of Binder cumulant shown in Fig. El goes well beyond the 
RS critical point. 



IV. GENERIC CONNECTIVITY k + 1 

The IRSB equations can not be solved in a fully analytical form: even in the simplest 
case {k = 2) one needs to use a population dynamics algorithm. However we can compute 
analytically the stability point Prsb and the point pp^ where the RS solution looses the 
magnetization. 

Let us call S{k, r) the probability of having a field h = r from the sum of k messages 
ui...Uk- Its definition is given by the two functions S+{k^r) = S{k,r) and S-.{k,r) = 
S{k, —r) with r > 0, 

S-i^-r) - f , _ ,, (35) 

where \_x\ is the largest integer not greater than x. 

For any given k, the self-consistency equations thus read 

Po = Sik,0) , (36) 

k 

rriKs = p'^^S+{k,r) - S-{k,r) . (37) 



r=l 



17 



Note that the right hand side of Eq.()37p is always an odd function in the variable mRs- 
Equations ()36I37|) admit a paramagnetic solution with m^s = and po = 0, a spin glass 

solution with m^s = and po = pg*^, where is the solution Eq.(|HH|) with rriRs = 0, and 

a ferromagnetic solution with m^s 7^ and po < p^'^. 

The point where the RS magnetization vanishes can be obtained expanding, for small 

mpts, the right hand side of Eq.(jnZj) 

= P c(po, k) TTiRs + 0{m^s) , (38) 

and imposing the coefficient to be equal to 1 with pq = Pq'^, i.e. with the system still 
unmagnetized: pp^ = l/c{pQ'^,k). 

In order to compute the instability point Prsb, one can proceed as in the previous section. 
For a generic k the matrix A4 reads 

M = \ ^ ^ ^ ^ 39 

with Z = kS{k- 1,0), P = k S+{k - 1, 1) and M = k S-{k - 1, 1). The instability point 
Prsb corresponds to the value of p for which the maximum eigenvalue of Ai becomes larger 
than 1 in absolute value. 

Let us eventually observe that the function S{k, 0) is a polynomial in po with only powers 
of the same parity of k. This implies that, for odd k, the solution pq = always exist, but 
it is stable under a small perturbation in pq only for p < po. The stability point po can be 
easily computed as the value where the coefficient of the linear term in S{k, 0) is equal to 
1. Analogously to what has been found in p-spin models jl^l, we find that for odd k the 
equality Prsb = Po always holds. 

In Fig.[7|we summarize the values of Prsb and pp^ for many values of the connectivity k+1. 
It is easy to check that Prsb > Pf^ strictly for any connectivity, and that Prsb ~ 

log(A;)/v^ 

and Pp^ ~ l/Vk for > 1. 

For all the values of p that we checked, the magnetization of a solution is a non- 
monotonous function of the reweighting parameter p. When plotted versus exp(— p) it 
has a parabolic shape, taking its maximum very close to the value of p maximizing $(p) 
and its minima at the extrema p = and p = oo corresponding to the RS solution. So 
the magnetization in the RSB solutions is typically larger than in the RS solution (see also 
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FIG. 7: Left plot: The RSB instability point prsb and the point where the RS solution becomes 
unmagnetized, as a function of the connectivity k+1. Right plot: rescaled variables. 

Fig.Hfor the k = 2 case). This implies the inequality pp^^^ < pp^, and the size of the mixed 
phase is bounded from below by the quantity (prsb — Pf^), which is strictly positive for any 
finite connectivity. 

lave also checked that in the k oo limit our results converge to those for the SK 



We 
model 
for pp^ simplifies to 



22j |. Indeed for odd k and p < prsb = Po the solution has po = 0, and the expression 



pf 



(fc-l)/2 
i=0 



k\ 



l\{k 



k-2i 



-1 



(40) 



In the k ^ oo limit, pp^ ~ A/vr/(2/c) which corresponds to the value found by De Almeida 
and Thouless j2^, once the energy of the system is rescaled by the proper y/k factor. 

The authors of Ref. reported that, if any mixed phase existed in the 3d EA model, its 
size would be very tiny: defining the relative size as 



Prsb — Pf 



(41) 



(Prsb + Pf)/2 ' 

their numerical findings are compatible with a relative size of 0.05 roughly. In order to 
compare such a numerical result for the 3d EA model with the analytical estimation of 
the mixed phase found here, we plot in Fig. |H1 the relative size of the mixed phase for 
different connectivities as a function of the critical temperature. The black big point in 
Fig. IHl corresponds to the numerical result for the 3d EA model. We see clearly that such 
a numerical finding is perfectly compatible with the mean-field prediction. Again, some 
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FIG. 8: The relative size of the mixed phase for a spin glass on the Bethe lattice as a function of 
the critical temperature. The big black dot is the result for the 3d EA model (after Ql). 

4d simulations are necessary to confirm or infirm the absence of a mixed phase in finite 
dimensions. 



V. SUMMARY AND DISCUSSION 



In this work we have studied analytically and numerically the low temperature phase 
of a spin glass model with ferromagnetically biased couplings defined on a Bethe lattice 
with fixed connectivity. We have shown that such a model has a mixed phase for any 
connectivity and that the relative size of such a mixed phase may change a lot with the 
connectivity. Exact locations of the phase boundaries have been computed numerically and 
even analytically when possible (e.g. Prsb for even connectivity). The instability which 
induces the spontaneous breaking of the replica symmetry has been deeply analyzed. 

Regarding the lack of a clear evidence for a mixed phase in the 3d EA model we have 
found many reasons for that. Under the Bethe approximation, the expected size of the 
mixed phase in 3d is very tiny and perfectly compatible to what has been found numerically 
in Ref. (see Fig. |HI). Finite size corrections on the numerical data are huge (see Fig. IHI). 
Consequences of the RSB may be very hard to detect numerically with small systems: e.g. 
the complexity in the mixed phase may be very small (see Fig.E)). Finally the same algorithm 
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may have some small bias, whose main effect is to reduce the size of the mixed phase. For 
all these reasons we believe that the study of the mixed phase is in general, as the study of 



the spin glass phase in field j23|, a very difficult task from the numerical point of view. 

Let us finish discussing a point that we believe interesting: the physical meaning of the 
equality Prsb = Po- For even connectivities the number of cavity messages arriving on a site 
is an odd number. So the solution with no null messages always exists. It is very curious that 
the RS-to-RSB instability studied here (as well as the lRSB-to-2RSB instability studied in 



Ref. [17|) coincides with the appearance of null messages. This coincidence strongly suggests 
that (for even connectivities) null messages are unphysical and they arise only when the 
solution ceases to be the correct one. The instability of the IRSB solution toward further 
steps of replica symmetry needs to be studied in order to check the above conjecture. 
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